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This paper presents a new model-reference adaptive control method based on a bi-objective optimal con- 
trol formulation for systems with input uncertainty. A parallel predictor model is constructed to relate the 
predictor error to the estimation error of the control effectiveness matrix. In this work, we develop an opti- 
mal control modification adaptive control approach that seeks to minimize a bi-objective linear quadratic cost 
function of both the tracking error norm and predictor error norm simultaneously. The resulting adaptive 
laws for the parametric uncertainty and control effectiveness uncertainty are dependent on both the track- 
ing error and predictor error, while the adaptive laws for the feedback gain and command feedforward gain 
are only dependent on the tracking error. The optimal control modification term provides robustness to the 
adaptive laws naturally from the optimal control framework. Simulations demonstrate the effectiveness of the 
proposed adaptive control approach. 


I. Introduction 

Adaptive control has been used with success in a number of flight control applications. In certain situations, fast 
adaptation is needed in order to improve tracking performance rapidly when a system is subject to large uncertainty 
such as structural damage to an aircraft that could cause rapid changes in system dynamics. In these situations, adaptive 
control needs to be able to adapt quickly by the use of a large adaptive gain in order to reduce the tracking error as 
fast as possible. However, the use of a large adaptive gain in adaptive control can result in high frequency oscillations 
which can excite unmodeled dynamics that could adversely affect stability of an adaptive law. 1 Poor robustness to 
unmodeled dynamics, time delay, and exogenous disturbances due to high gain adaptive control is well-known. Thus, 
typically there exists a balance between stability and adaptation. A large adaptive gain generally can improve tracking 
performance but usually at the expense of robustness. 

To address the lack of robustness of the standard model-reference adaptive control, the two well-known robust 
modification methods in adaptive control, namely; the o modification 2 and e modification, 3 have been used exten- 
sively in adaptive control. Recent years have seen a surge in many new adaptive control methods such as the 3£\ 
adaptive control, 4 adaptive loop recovery, 5 Kalman filter adaptive control, 6 derivative-free adaptive control, 7 compos- 
ite model-reference adaptive control, 8 and optimal control modification; 9 just to name a few. In terms of addressing 
fast adaptation, the Jzfj adaptive control has gained a considerable attention due to its ability to achieve robustness 
with fast adaptation for a given a priori bound on the uncertainty. The existence of theoretical bounds on the transient 
performance and time delay margin of the Jzfj adaptive control enables it to address one of the current challenges in 
verification and validation: the lack of theoretically justifiable metrics. 10 One of the key features of the Jz?i adaptive 
control is the existence of a linear input-output mapping with fast adaptation which helps to address the problem with 
predictability of nonlinear control. 

The optimal control modification has been developed using an optimal control framework to minimize the Jz ?2 
norm of the tracking error bounded away from the origin by some lower bound. 9 By increasing the lower bound, 
robustness can be improved by trading off with tracking performance. This adaptive control method in some way 
can be shown to possess a certain degree of similarity to the Jz?i adaptive control with respect to fast adaptation. In 
particular, the optimal control modification can be shown to have an asymptotic linearity between inputs and outputs 
under the fast adaptation assumption. 1 '■ 12 - 14 Hence, stability robustness of the optimal control modification can easily 
be analyzed. 

A number of extensions have been developed for the optimal control modification method. In the presence of 
actuator rate limiting, a time-scale separation principle is applied to the method to decouple the slow-fast system via 
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the singular perturbation. 13 This approach improves tracking performance in the presence of slow actuator dynamics. 
For problems with control input uncertainty that limits the control effectiveness, a state predictor method has been 
developed for the optimal control modification to accommodate both the control input uncertainty and matched uncer- 
tainty. 14 In the presence of linear matched uncertainty with fast adaptation, the optimal control modification method 
has been observed to exhibit an asymptotic linear property which has been further exploited to develop an analytical 
method for estimating a lower bound of the time delay margin for a given a priori information on the parametric uncer- 
tainty. 11, 12, 14 The optimal control modification method has also been used in conjunction with the newly developed 
derivative-free adaptive control. 

In terms of applications and validation, the optimal control modification method has been demonstrated in many 
flight environments ranging from low-fidelity desktop simulations, to medium-fidelity motion-based flight simulator 
experiments, and to the ultimate high-fidelity flight testing on a piloted aircraft. For desktop simulations, the optimal 
control modification method has been applied to various aircraft models including NASA Generic Transport Model 
(GTM) with damaged flight dynamics 9 and aeroelastic longitudinal dynamics, 16 a general aviation aircraft, 17 and a 
NASA F/A-18A aircraft model. 18 For medium-fidelity validation, a pilot evaluation study has been conducted in a 
motion-base flight simulator at NASA Ames Research Center in 2009 by eight NASA test pilots. Favorable Cooper- 
Harper ratings by the NASA test pilots have been noted with the optimal control modification adaptive law. 19,20 
For high-fidelity validation, a series of flight experiments have recently been conducted in late 2010 and early 2011 
onboard a NASA F/A-18A test aircraft at NASA Dryden Flight Research Center to evaluate the effectiveness of the 
optimal control modification method. The flight test results show that the optimal control modification method offers 
the potential for flight control performance improvements under certain degraded flight control characteristics. 21,22 

In certain situations, the control effectiveness of a control system may be impaired due to failures. When an 
uncertainty exists in the control input, the system can undergo significant changes in its closed-loop characteristics 
that can compromise stability and performance of the control system. The control signal must be modified accordingly 
to produce achievable dynamics in the presence of the reduced control effectiveness. A new approach based on the 
optimal control modification adaptive law has been developed to address this issue. A parallel predictor model is 
constructed to relate the predictor error to the estimation error of the control effectiveness matrix. In this work, 
we will develop an optimal control modification adaptive control approach that seeks to minimize a bi-objective linear 
quadratic cost function of both the tracking error norm and predictor error norm simultaneously. The resulting adaptive 
laws for the parametric uncertainty and control effectiveness uncertainty are dependent on both the tracking error and 
predictor error, while the adaptive laws for the feedback gain and command feedforward gain are only dependent on 
the tracking error. In this context, the new adaptive law is similar to the composite model-reference adaptive control, 8 
but the difference lies in the optimal control modification term that provides robustness to the adaptive laws naturally 
from the optimal control formulation. 

II. Bi-Objective Optimal Control Modification Adaptive Laws 

Consider the following nonlinear system with control input uncertainty, match uncertainty, and unmatched distur- 
bance 

x = Ax + BA m + ©* t <F(x) +w (1) 

where x(t) € R" is a state vector, u ( t ) € R'" is a control vector, A e R” x R" is known. Be R” x R m is also known 
such that (A,B) is controllable, A = A T > 0 € R m x R'" is a constant unknown diagonal matrix with diagonal elements 
that represents a control input uncertainty, ©* e R p x R m is a constant and unknown matrix that represents a matched 
parametric uncertainty,, <f> (x) e R p is a known structure of the match uncertainty, and w (t ) e R" is an unmatched 
bounded disturbance with bounded time derivative, i.e., supy r 1 1 w 1 1 < wo and supy, ||vv|| < vvo- 

A nominal fixed gain controller is designed to stabilize the nominal plant with no uncertainty, i.e., A = I and 
©* = 0, and to enable it to track a reference command signal r (t) as follows: 

u = K x x + K,r (2) 

where r (t) e R r is a bounded reference command signal, such that A + BK X e R" x " is Hurwitz, and BK r e R” xr . 

The closed-loop nominal plant without uncertainty is then used to specify a reference model 

Xm = A m x m T B m r (3) 

where x m ( t ) e R” is a reference state vector, A m = A + BK X , and B m = BK r . 
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In the presence of both the control input uncertainty and matched uncertainty due to A and ©*, an adaptive con- 
troller is designed as 

u = K x (t)x + K r ( t)r — © T (t ) <i> (. x ) (4) 

where K x (t) £ K m x K" is an adaptive feedback gain, K r ( t ) £ R'" x R r is an adaptive command feedforward gain, and 
© (t ) £R p x M m is the estimate of ©* . 

We assume that there exist constant and unknown matrices K* and K* such that the following matching conditions 
are satisfied 

A K = K x (5) 

AK* = K r (6) 

If A is unknown but sign of A is known, then the standard MRAC adaptive laws are given by 


kj = T x xe J PBsgnA (7) 

kj = r r re T PBsgnA (8) 

© = — (x) e T PBsgnA (9) 

It is well-known that the standard MRAC is non-robust. To improve robustness, the adaptive laws should include 
a robust modification scheme or the projection method. If A is completely unknown. Then, we need to consider other 
approaches. We now introduce an optimal control modification method that uses two types of errors for adaptation: 
tracking error and predictor error. We call this bi-objective optimal control modification adaptive control. 

Let A (t) = A ( t ) — A, K x (t) = K x ( t ) — K*, K r (t) = K, (t) — K*, and © (t) = © ( t ) — ©* be the estimation errors. 
Then the closed-loop plant becomes 


x = A m x + B m r + B (A — A) 


K x x + K,r — © T <i> (x) 


-w 


( 10 ) 


Then the tracking error equation becomes 


e = A m e + BA 


—K x x — K,r + 0 1 ( I> (x) 


- w + Be 


where e (x, r) £ R m is the residual estimation error of the plant model 


e = A 


K x x + K,r — © T <t> (x) 


( 11 ) 


( 12 ) 


such that supy v r ||e|| < £o. 

Consider a predictor model of the plant as 


x = A m x+(A—A m )x + BA m + © t <J>(x) 


where w (t) is the estimate of the disturbance w ( t ). 

We define the predictor error as e p ( t ) = x(t) —x{t), then 


— A m e p -f BA 


m + © t <J>(x) +BA® r <t>(x) + w + Be p 


(13) 


(14) 


where w(t) = vt>(f) 
predictor model 


w (t ) is the disturbance estimation error, and e p (x) £ R m is the residual estimation error of the 


e p = -A© T <I>(x) 


(15) 


such that supy Y 1 1 1 1 < e Po . 

Proposition: The bi-objective optimal control modification adaptive laws are defined as: 


kj = r x x (e T P+vu T A T B T PA~ l ^j BA (16) 

kj = T \r ( e T P+Vu T A T B T PA m ^ BA (17) 
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0 = -r 0 O(x) ( e' P+VU 1 A' B' PA m l +e' p W -r\ { |n + 2©'<I>(x) 

lT 


a 1 = -r A 


( + ©'<I>(x) 


elW-i 1 


i + 2© <t> (x) 


A B +w j WA~ \BA 
A T Z? T + h ,t 1 WA ~ 1 ^ B 


= ~Yw ( ejw - rj 


n + 2© T <f>(x) 


1 T 


A t B t + m> t \\VA-, 1 


(18) 

(19) 

( 20 ) 


where T* = rj > 0 G R" x W, F r = rj > 0 G M r x R r , T© = Tq > 0 G R" 1 x R m , r A = rj > 0 G R p x R p, and 

Yw > 0 G R are adaptation rate matrices; v > 0 G R and rj > 0 G R are the optimal control modification parameters; 
and P = P T >0gR" x " and W = W > 0 G R" x " are solutions of the following Lyapunov equations 


PA m +Aj n P — —Q 

(21) 

WA rn +Aj n W = ~R 

(22) 


where Q = Q T > 0 G R” x " and R = R T > 0 G R" x " are positive definite weighting matrices. 

We note that K x and K, are adapted based on the tracking error, A and w are estimated using the predictor error, 
and © is adapted based on both the tracking error and predictor error. 

The adaptive control architecture with the bi-objective optimal control modification is presented in Figure 1. 


w 



Figure 1 - Adaptive Control Architecture with Bi-Objective Optimal Control Modification 


Proof: The optimal control modification adaptive laws are called bi-objective because they use both the tracking 
error and predictor error for adaptation and are derived from the following infinite-time horizon cost functions 


J i 


1 T 

lim - / (e — Ai) Q(e — A\)dt 

tf—>OC 2 J Q 


(23) 


h 



A if R{e p 


A 2 )dt 


(24) 


subject to Eqs. (11) and (14), where Ai and A 2 represent the unknown lower bounds of the tracking error and the 
predictor error, respectively. 

The cost functions J\ and J 2 are combined into the following bi-objective cost function 


J — J\ +J 2 


( 25 ) 
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The bi-objective cost function J combines both the objectives of minimization of the tracking error and the pre- 
dictor error bounded away from the origin. Geometrically, it represents a distance measured from a point on the 
trajectory of e (f)and e p ( t ) to the normal surface of a hypersphere B\ = |e (t) € M”,e p (f) gl" : (e — Ai) T Q(e — Ai) 

+ (e p — A 2 ) T R(e p — A 2 ) < oj C C R”. The bi-objective cost function is designed to provide stability robustness 
by not seeking asymptotic tracking and predictor errors that tend to zero as tf — * °°, but rather errors that tend to some 
lower bound away from the origin. By not requiring asymptotic tracking and predictor errors, the adaptation can be 
made more robust. Therefore, the tracking performance can be traded with stability robustness by a suitable selection 
of the modification parameters v and 77 . Increasing the tracking performance by reducing v and or 77 will decrease 
stability robustness of the adaptive laws to unmodeled dynamics, and vice versa. 

The derivation of the adaptive laws is established by the Pontryagin’s Minimum Principle. Using the optimal 
control framework, the Hamiltonian of the cost function is defined as 


H= 2 (e ~ 


\ (e- Ai) t Q(e- Ai) + j (e p - A 2 ) R(e p - Az) + V ^A m e + BA -K,x- K r r+@ J ®(x) -M' + 6eJ 


+m t [- 


~\~ BA 


m + © t <J>(x) + Z?A© t <J>(x) + w + Z?£p I (26) 


where A ( t ) : [0,°°) — > K" and /x (t) : [0,<=°) — » K" are adjoint variables. 

The adjoint equations can be obtained from the necessary conditions of optimality as 

A = -Vf/J = -Q( e - Aj) -Al A (27) 

fl = -VHj p =-R{e p -A 2 )-AZn (28) 

subject to the transversality conditions A (f/ — > °°) =0 and n(tf ° °) = 0 since both e (0) and e p (0) are known. 

Treating K x , K r , ©(f). A, and w as control variables, then the optimal control solutions are obtained by the follow- 
ing gradient-based adaptive laws: 

(29) 


kJ = kJ = -r x VH kx = y x x\ j bK 
kj = kJ = r,v// A > r = u-rA'/M 
© = © = -r 0 v//i = -r 0 o(v) (a t + m t ) 

1 1 + © T <I> (x) 


BA 


A 1 = A T = -r a vh a = -r A 


jU T B 


k T = -y w VH A = — 7 „./ x t 


(30) 

(31) 

(32) 

(33) 


The closed-form solutions can be obtained by eliminating the adjoint variables A (f) and 7/ (f) using the “sweep” 
method with the following assumed solutions of the adjoint equations 


A =Pe + S 


—K x x — K r r+ © T <J> (x) 


B — BAp + T 


u + 2© <I> (x) 


+ V 


(34) 

(35) 


Substituting the adjoint solutions back into the adjoint equations yields 


Pe + PA m e + PBA 

+ S 


—K x x — K,r + © T <J> (x) 
~K x x~K,r-\ © 1 O (x) 


-PBA 


-K*x-K* r r + ®*' (x) 


— Pw + PBe 


d \— K x x — K r r + & 1 <I>(x)l . . T 

+ 5^^ ^ ^ = ~Q(e~ A, ) -Aj n Pe 


dt 


-ALs 


—K x x — K, r + © ' ( I> (x) 


(36) 


We p + WA m e p + WBA 


( + © t 4>(x) 


— WBA 


i + © 1 (x) + WBA® 1 4> (x) - WBA©* t T> (x) + Ww - ffw 


+ WBe p + T 


( + 2© t <J>(x) 


, d n + 2© T <J>(x) 


dt 


+ V = -R{e p -A 2 )-Aj n We p 


- aIt 


( + 2© t <J>(x) 


-A' m V (37) 
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Equating terms yields the following equations 


P + PA m +Aj n P + Q = () 

s+aJ 1 s+pba = o 


QAx+PBA 


-K*x-K; r + ®*'<t>(x) 


+ Pw - PBs 


d —K x x — 
S -A 


/Sf,.r + © T <I>0) 
dt 


= 0 


W + WA m +Alw + R = 0 
T +A J m T + WBA = 0 
V+A J m V + Ww = 0 


ra 2 +wba 


+ ® 1 0) + WBA®* t <P (a) + Ww - WBs p - T 


d li + 2© T <f>(x) 


dt 


-V = 0 


(38) 

(39) 

(40) 

(41) 

(42) 

(43) 

(44) 


subject to the transversality conditions P (tf — > oo) = 0, S (tf — + °°) = 0, W (tf — > oo) = 0, and T (tf — > °o) = 0. 

The existence and uniqueness of the solution of the Lyapunov differential equations. The infinite-time horizon 
solutions of P(t) and VV it) as tf — > °° of the Lyapunov differential equations tend to their equilibrium solutions at 
t = 0 

PA m +Aj n P + Q = 0 (45) 

WA m +Aj,W + R = 0 (46) 


and the solutions of S ( t ), T (f), and V ( t ) tend to their equilibrium solutions 


Aj n S + PBA = 0 (47) 

Aj n T + WBA = 0 (48) 

Aj n V + Ww= 0 (49) 


As with any control design, performance and robustness are often considered as two competing design require- 
ments. Increasing robustness tends to require a compromise in performance and vice versa. Thus, to enable the 
bi-objective optimal control modification adaptive laws to be sufficiently flexible for control design, the modification 
parameters v > 0 and q > 0 are introduced as design free parameters to allow for adjustments of the optimal control 
modification terms in the adaptive laws. 

Thus, the solutions of S (f), T (f), and V ( t ) are given by 


S = -vA m J PBA 

(50) 

T = - riA m T WBA 

(51) 

V = -riA~ J Ww 

(52) 

Using the expression of u (f), the adjoint solutions are then obtained as 


A =Pe+ vA m J PB An 

(53) 

p = We p - riA m J WBA \u + 2© T 4> (x)j - r]A~ T Ww 

(54) 


Substituting the adjoint solutions into the gradient-based adaptive laws yields the bi-objective optimal control 
modification adaptive laws. 

The bounds on Ai ( t ) and At ( t ) as tf — > °° are given by 


llAill < 


1 

^min (( 2 ) 


PBA 


-K*x-AK*r + @* J ® 0) II +K l ax{P)w 0 +\\PB\\ £ 0 


+ v 


A~ r PBA 


d - K x x — K,r + 0 <b (a) 


dt 


(55) 
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INI < 


1 


^nin (P) 


WBA\\ m + ® t 4>(x) 


WBA 


©' ^(x) || + X, nax (w) WO + ||WB|| £pg 

d [u + © 7< f> (x)] 


AZ t WB 


dt 


( 56 ) 


which are dependent upon the modification parameters, control effectiveness uncertainty, matched uncertainty, un- 
matched disturbance, and residual tracking error and predictor error. 

Note that if R = Q and r] = v, then the bi-objective optimal control modification adaptive laws for ©(f), A (f), and 
w (f) become 

} 1 ) j 


© = — ro4>(x) (e T P + eJ,P — V 


|24> t (x)©A t B t + w t 1 


a 1 = -r* 


m + 0 7 O(x) 


e T p P-V 


= ~Yw [elP-v 


u + 2© t< J> (x) 
T 


lT 


T D T , ,~T 


u + 2© <J> (x) 


A 7 B 7 + w 7 [PA-, 1 


BA 

(57) 

PA m ^B 

(58) 

1 

(59) 


Theorem: The bi-objective optimal control modification adaptive laws result in stable and uniformly ultimately 
bounded tracking error e (f) and predictor error e p (f). 

Proof: Choose a Lyapunov candidate function 


V (e,e p ,K x ,K r ,Q,A,w) = e T Pe + eJ } We p + trace (k x F x 1 Kj j -l-trace 1 K X 


+ trace (o 7 !^ 1 ©) +trace (Al^'A 7 ) + w l y- 1 w (60) 


Evaluating V (e,e p ,K x ,K r ,&,A,w) yields 


V = e T (pA m + A 7 b) e + 2e J PBA 


—K x x — K r r + © 7 <f> (x) 


- 2e 7 Pw + 2e T PBe 


+ ej (wA m + Alw ) e B + 2 e J n WB { A 


|A w + © 7 4>(x) + A© 1 T> (x) | + 2e J Ww + 2e 7 WBe p 


+ 2trace (^K x x [e J P + vn T A T B T PA W 1 ) BA ) + 2trace 


- 2 trace ( © 1 <f> (x) ( e 1 P + Vu T A T B T PA m 1 + e T W - rj { \ u + 2© 1 <f> (x) 


{k r r (e T P+ Vu t A t B t PA~ 1 ) BA 


A T B T +w T \wA m l ) BA 


— 2trace A 


I + © 7 <t> (x) 


eJW-rj 


( + 2© 7 <J>(x) 


+ 2 ?7 


A 7 B 7 + w 7 \ WA-, 1 )b) ~2eJWw 


lT 


+ 2© 7 4> (x) A 7 B 7 + w 7 \ WA~ 1 w - 2w 7 y ~ 1 w (61) 


Using the trace identity trace (A 7 B) = BA 7 , V (e,e p , K x , K r . 0. A. w) can be further simplified ; 


V = —e T Qe — 2e T Pw + 2e T PBe — elRe p + 2elWBe p — 2w 7 y H , 1 w 


+ 2vw t A t B t PA m l BAu + 2r ) trace ^0 T <£(.*;) 


+ 2?]trace ^A 


w _l_0 T c|)( x ) | |w + 20 t< I>(x) 
+ 2rj trace (w 


+ 2© 7 <t>(x) 
T 


T 


A B + w ) WAT' BA 


A 7 b 7 +w 7 [wa-Jb 


( + 2© 7 <J>(x) 


lT 


A 7 B 7 +w 7 )-wa~ 


(62) 


where u = K x x + K,-r — ©<t> (x) . 
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Let .6 = 

BA B I 

GR n xR 2m+n ,a = 

’ © 0 0 
o A 7 o 

eRP+ m+1 xR 2m +",T / (x,r) = 

<L(x) 

m _|_@ t <J)(x) 




O 

O 

H 


1 


RP+ m + 1. Then 

(Cl T '¥ (x, r) I* 7 (x, r) £lB J WA m l 


trace 


trace A 


B j = trace [ © ! <f> (x) \u + 2© 1 <I> (x) 
T 


lT 


A B +m> > WA7„BA 


m + © <J> (x) | { | u + 2© <t> (x) 

+ trace ( w 


A T B T +w T }WA m l B 


1 T 


A t B t +m> t >WA m ! ) (63) 


m + 2© t <I>(x) 


Thus, 

V = —e T Qe — 2e T Pw + 2e T PBe — ejRe p + 2eJ,WB£ p — 2w T Y~ l w 

+ 2vu T A T B T PA m l BAu + 2ri^ T {x,r)Q.B T WA~ 1 BCl Ty ¥ (x,r) (64) 

Note that PA~ 1 and WA~ 1 are both negative definite matrices, therefore 

V = -e J Qe - 2e T Pw + 2e T PB£ - e J p Re p + 2 e^WBe,, - 2w T y vt 7 1 w 

- vu T A T B T A- T QA~ l BAu - 77^ t (x, r) ClB J A m J RA m { BQJ'P (x, r) 

+ 2vm* t A 7 B t PA m l BAu + 2r)'i ,T (x, r) Q.*B t WA~ 1 bCi t ' V (x, r) (65) 


Let = 


K x K r © 


eM ,«x(n+r+p) an( j i (x, r) = 


X 

r 

3>(x) 


G M( n + r +/0. Then u = Kz{x,r) and 


V <-Kin{Q)\\e\\ 2 + 2\\e\\Kax{P)w^ + 2\\e\\\\PB\\£ Q -Xmin (R)\\e p \\ 2 + 2\\e p \\\\WBl 


'PO 


B T PAZ l B 


|A|| 2 ||^||/f 0 


+ 2r- 1 ||f2||w 0 -vA m! -„ (B T A- T GA ) ; I fi)||z(x,r)|| 2 ||A|| 2 ||^|| 2 + 2v||z(x,r) 

— R^min (aT/^A,^ 1 ) || v P(x,r) || 2 1|5|| 2 ||f2|| 2 + 2 tj jjWA” 1 1| ||'P(x,r)|| 2 ||fi|| 2 ||i2|| (66) 

Let Cl = Km (2). c 2 = c 3 = A mi „ (/?), C 4 = c 5 = ( B T A m T QA m l B ) ||z(x,r)|| 2 , c 6 = 

f^ll^ v C 7 = Kin (A- 7 ^ 1 ) ||*P(x, r)|| 2 , and C 8 = 11 

tRT 4 2:Trt4-lRV m m ’ 11 V rjK in {Am T RA^)\\V{x,r)\\ 2 Bl 


Amin (tL A m ~T QA m ' /t j 

v < -Cl (||e|| -C 2 ) 2 + C 1 C 2 -C 3 (||c p || — c 4 )“ + c 3 c 2 


Then 


-vc 5 ||A|| z (||^||-c 6 ) / + vc 5 cg||A|| z -77 C7 ||B|| 2 (||f2||-c 8 ) z + 77c 7 cl||B|| 2 (67) 


Note that 


|| A|| < ||fi| => ||A|| < ||q|| 

||A|| 2 = ||A + A|| 2 < ||A|| 2 + 2 ||A|| ||A|| + ||A|| 2 < ||A|| 2 + 2 ||A|| ||n|| + ||fl| 


'B|| 2 = B*+B z < ||B*|| z + 2||B*|| B + B z = ||B*|| Z + 2||B*|| ||B|| A +||B|| Z A 


r»* 1 1 2 


|2 II A || 2 


< ||B*|| 2 + 2||B*||||B|| Cl + 


( 68 ) 

(69) 


|B|| 2 p|| 2 (70) 


where II B* II = BA B I € R” x R 2m+ ". 
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Thus, V {e,e p ,K,£i) < 0 outside a compact set b/' defined as 


< (e(t),e p (t),K(t),Ci(t)) :ci (||e|| -c 2 ) 2 + c 3 (\\e p \\ -c 4 ) 2 + vc 5 Aq (\\k\\ - c 6 ) 2 


+ J 7c 7 fio(||^|| ~ c zY ^ C!cl + c 3 cl + vc 5 clAl + ric 7 clBl l (71) 


where A 2 = l|A|| z + 2 ||A|| eg + c| and fi 2 = ||B*r + 2||B*|| ||B|| eg + ||fi|| 2 c 2 . 


This implies 


HI>C2 + jtj + — + VC ’ C ‘*° + nClClBi 


Ml >c t + Jc\ + C ^^A±3^« =p 


c 3 


>C6+\ C ' { 


2 | ClC2 + C3q + T7C7C^p _ 


VC5A5 


& >c& + \ c i 


c 3 c\ + c 3 c\ + vc 5 c^A 5 


/7C7B5 


= a 


= (3 


(72) 

(73) 

(74) 

(75) 


Note that the bounds are dependent on ||z(x,r)|| and ||'E(x,r)||. Then it can be shown that there exist zo and 
'Pq such that ||z(x,r)|| < zo and j| v F(x,r)|| < T'o for any 0 < V < V max and 0 < 77 < r\ max that satisfy the following 
inequalities: 

<p(||x|| ,||x m || ,Q,v,w 0 ,£ 0 ,Aq,Kq) = ~c\ ||x|| 2 + 2 (cic 2 + X max (Q) ||x m ||) ||x|| +2cic 2 ||x m || -c\ ||x m || 2 

+ c 3 cj + vc 5 ( I |z (x, r) 1 1 ) c\ A5 + 7]C 7 ( || T* (x, r) || ) < 0 (76) 


0 (|M , |x,„|| ,R,r],wo,£p 0 ,Bo,Clo) = -c 3 ||x p || + 2 (c 3 c 4 + hmu {R) ||*||) ||*p|| +2c 3 c 4 ||x|| -c 3 ||x|| 2 

+ Cl c\ + VC 5 ( ||z (x, r) || ) c\ A5 + tjc 7 ( 1 1 ' *P (x, r) || ) c\bI < 0 (77) 

Therefore, the closed-loop system is uniformly ultimately bounded with the following ultimate bounds: 


e < 


I Knox ( P)r 2 + X max ( W)p 2 + X max (T* 1 , T r 1 , F 0 1 ) a 2 + X max (T 0 * > r A 1 , Yw 1 ) P 2 


Xmin ( R) 


(78) 


\e p \\ A 


K < 


n < 


I Xmax (P)r 2 + Xmax (W) p 2 + Xmax (T x jT r ,T 0 ) 0£ 2 + Xm ax (r @ ,T A , y H > ) /3 2 

Xmin (W) 

I Xmax (P) r ~ + Xnax (fF) P~ + Xnax 1 ,r,- Tq 1 ) Ct~ + X max (Tq 1 , , Jw 

Xmin (F* 1 ,T r ‘.Tg, 1 ) 

I Xmax W Xnax (W) P~ + Xnax (fx 1 jTr ^ T© 1 ) + X„,ax (Tg) 1 , IT^ 1 , y, v ^ 


Xmin (r 0 , r A , y w ) 


(79) 

(80) 
(81) 


Example: Consider a first-order SISO plant 

x = ax + bX \u (f — td) + 0*x 2 ] + w 

where a = — 1 and b = 1 are known, X = — 1 and 0* =0.1 are unknown, t,i = 0.2 sec is a known time delay, and 
vv (t) = 0.01 (sinf + cos2f) 
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The reference model is given by 


X m — Q-mXm I b m r 

where a m = —2, b m = 2, and r(t) = sinr. 

The nominal control input effectiveness is equal to unity, i.e., X* = 1. So, X = — 1 represents a full control reversal. 
The adaptive controller is designed as 

u = k x {t)x + k r r (r) — 0 ( t)x 2 


where k x (r), k r (r), and 9 ( t ) are computed by the following bi-objective optimal control modification adaptive laws: 

lc x = y x x ( e + va m l ub X ) bX 


X 


k r = y r r (e + Va m 1 ubX ) bX 


o = -Tex 2 

e + ep-vaj 

29x 2 bX + ti'j 

bX 


-yx (u + 0x 2 ) |e p - vaj 

(M + 20X 2 ) bX+w 

} b 


w = — y w — va m l (n + 20x 2 ) bX + w | 


where the predictor error e p (f) = x(t) — x(t) is computed from the predictor model 


x = a m x+ ( a — a m )x + bX [n (f — t,j) + 0.v 2 ] + vi> 

The initial conditions are k x (0) = k*, k r (0) = k*, 9 (0) = 0, X (0) = X* , w (0) = 0. The adaptive gains are chosen 
to be y x = y r = ye = y\ — y-w = 10, and the modification parameters are chosen to be v = 0.1 and tj = 0.01. 

The closed-loop response with r ( t ) = sinr for t £ [0, 100] is shown in Figure 2. It can be seen that x ( t ) eventually 
tracks x m (f), but the two signals are initially 180° out of phase due to the control reversal. The signal x (f) approximates 
x(t) very well. 




Figure 2 - x(f), x(f), and x m ( t ) 

The control parameters k x (r), k r ( t ), and 9 (r) are shown in Figure 3. These parameters appear to converge to their 
ideal values. The convergence is facilitated by having a persistently exciting reference command signal r(t) = sinr. 


10 of 17 


American Institute of Aeronautics and Astronautics 



t 

Figure 3 - k x (f), k r (; t ), and 9 (t) 

The control input uncertainty X (t) and unmatched disturbance w(t) are estimated as shown in Figure 4. 




Figure 4 - X (t ) and w(t) 

Overall, the bi-objective optimal control modification adaptive laws demonstrate good tracking performance. 
Remark: Consider an alternate representation of the plant in Eq. (1) 


x = Ax + B 


0* 4> (x) 


(82) 


where B is unknown. 

Then, the bi-objective optimal control modification adaptive laws can be recast as 


kj = r X x[e' P + vu' B' PA m L ) B 


T 


T nT r)A -1 


kj = T r r ( <? 1 P + VII 1 B 1 pa;' ) B 


JdT, 


(83) 

(84) 
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© = — r©4>(x) ( e T P+ vli B r PA m l +eJ,W — rj < u + 20 T <f> (x) 


1 T 


B +w }WA m l B 


b 1 = -r* 


u + © 1 $ (x) 


eJW-r 7 


tv T = — 7w ( eZW-ri 


i + 2© 1 <I» (jc) 


M + 2© 1 <J> (jc) 
T 


lT 


B J + w T \WA~ X 


B J + w J \WA- 1 


where B is the estimate of B. 


(85) 

( 86 ) 

(87) 


III. Flight Control Simulation 

Consider a longitudinal pitch dynamic model of an aircraft 

C Lf ,qSc 


mV 


^ 2V 

0 

C m& qSc 2 

2V 


0 0 
1 0 


0 A 


yy 



a 



9 

= 


4 _ 



mg 7 - C La qS - mgy mV f 'y 

0 0 1 

C,„ a qSc 0 

~^ L B e 





a 


9 


1 . 


±A 


0 


c, 




<5 e (f — A/) + 


9* 0 0* 


a 

3 


w a 

9 


+ 

we 

<7 . 

J 


w q 


( 88 ) 


where tj = 50 msec is a time delay introduced to account for unmodeled dynamics, and A € [0, 1] is the control input 
effectiveness, normally equal to 1 . 

A numerical model for a full-scale generic transport model (GTM) at Mach 0.8 and 30,000 ft with the flight path 
angle 7 = 0 is given by 


•S -CD 

— 




—0.7018 0 0.9761 

0 0 1 
-2.6923 0 -0.7322 



a 


’ -0.0573 ' 

( 



a 


9 

+ 

0 

+ 

co 

9* 0 9* 


9 


1 . 


-3.5352 

V 


1 


w a 

w e 

w, 


where the disturbances are given by 


w a 


0.01 sinr — 0.05<± 01/ cos 2 1 

w e 

= 

— 0.01cos4 1 

Wq 


0.02e^°' 5r sin 3 1 — 0.03 cos t sin2f 


A desired reference model of the pitch attitude is given by 

9m {t ) "t“ 2 C (On 9 m (t) ± (O n 9 m (t) — (O n r it j 

where £ = 0.85 and 0J„ =1.5 rad/sec are chosen to give a desired handling characteristic. 
lT 


Let x = 


a 9 q 


, u = 8 e , ©* 1 = 


9* 0 0; 


0.4 0 -0.3071 


<? J 

(89) 

(90) 

(91) 

, and A = 0.5. The para- 


metric uncertainty ©* and the control input uncertainty A result in short-period mode damping ratio of 0.2418, 
which is almost half of nominal short-period mode damping ratio of 0.4045. A nominal controller is designed with 

Kx= h fl 3t 2 £®„+a 33 = -0.7616 0.6365 0.5142 and k r = ^(o; t = -0.6365. The closed-loop 

eigenvalues of the ideal plant are —0.6582 and —1.2750 ±0.7902;. The nominal closed-loop plant is then chosen to 
be the reference model as 


oc m 


’ -0.6582 

-0.0365 

0.9466 


oc m 


’ 0.0365 ’ 


= 

0 

0 

1 



+ 

0 


y v. 

0 

-2.2500 

-2.5500 



y v« 

2.2500 

x m 



Am 



Xm 


B m 


( 92 ) 
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If the adaptive controller is given by 


— M-nom T Mad 


(93) 


where 


u nom 


K x x+k r r 


u ad = AK X (t ) x + Ak r (t ) r - © T (? ) x 


(94) 

(95) 


A Kj = F Kx x ( e 1 P+Vu' ad A ! B 1 PA~ l ) BA 


T A T nT DA~ 1 


then, AK X (?), A k r (. ? ), and © T (?) are computed from the following bi-objective optimal control modification adaptive 
laws: 

(96) 

(97) 

BA (98) 


Ak r = Yk,r (e T P + VuJ d A T B T PA m l ) BA 


© = -r@x ( e J P+ vuJ d A J B J PA m 1 + eJ,W - 77 


( + 2© T <J>(x) 


T 


B J +w T \WA 


A 1 = -r A 


m + © t x 


eJW-r 7 


u + 2© t< J> (x) 


A T B T +w T > WAY.} 1 B 


(99) 


= — 7w 


elW-ri 


u + 2© 1 <J> (x) 


lT 


A t B t 


wa~ 


( 100 ) 


These adaptive laws are alternative expressions to those of Eqs. (29) to (33) and (83) to (87). 

Figure 5 shows the aircraft response due to the baseline controller. With no adaptation, the closed-loop plant 
becomes unstable after about 23 sec. Figure 6 is the plot of the aircraft response with the standard MRAC for the 
adaptive gains T^.x = T© = Ta = 50 1 and y w = 50. The command tracking has improved considerably. However, 
there is a large initial transient in the pitch rate response as well as high frequency oscillations. 

Figure 7 shows the aircraft response with the bi-objective MRAC when v = 77 = 0. The closed-loop becomes 
unstable after 9 sec. The instability of the adaptive laws is consistent with the theory which shows that 77 cannot be 
zero when an external disturbance w (?) exists due to the term cs in the stability theorem. Moreover, it is also consistent 
with the MRAC theory which shows that the standard MRAC generally exhibits a parameter drift in the presence of a 
disturbance. To prevent parameter drift, the disturbance estimate w (?) must be bounded by setting 77 > 0. Alternatively, 
if the disturbance w (?) is not estimated by setting y w = 0, then stability of the bi-objective MRAC will be restored 
since the term cs becomes bounded for 77 = 0. Figure 8 illustrates this observation whereby the aircraft response 
becomes stable when y w = 0. Comparing the aircraft response with the bi-objective MRAC with y w = 0 to that with 
the standard MRAC, it can be seen that the bi-objective adaptation significantly reduces high frequency oscillations in 
the pitch rate response. 

Figure 9 shows the aircraft response with the bi-objective optimal control modification for the same adaptive 
gains with v = rj = 0.4. The pitch rate response is significantly improved with virtually no noticeable large initial 
transient and high frequency oscillations. However, the pitch attitude tracking is somewhat degraded. This is entirely 
expected since the bi-objective optimal control modification adaptive laws trade tracking performance for improved 
robustness. Comparing the aircraft response with the bi-objective MRAC to that with the bi-objective optimal control 
modification, it can be seen in the pitch rate response that the bi-objective optimal control modification results in 
smaller initial transients and better tracking. 

Figure 10 compares the elevator deflections produced by all the different controllers. The elevator deflection 
produced by the baseline controller is well within the position limit, but instability still occurs. All adaptive controllers 
with MRAC exhibit control saturation and high frequency oscillations to various extents. The elevator deflection with 
the standard MRAC exhibits significant high frequency oscillations and control saturation. The elevator deflection 
with the bi-objective MRAC with y w > 0 is in full saturation before the controller goes unstable. In contrast, the 
bi-objective MRAC with y w = 0 causes only an initial control saturation of the elevator deflection. The amplitude of 
the control signal then rapidly improves with small periodic transients. In contrast, the bi-objective optimal control 
modification produces a well-behaved control signal for the elevator deflection with no discernible saturation or high 
frequency oscillations. 
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Figure 5 - Unstable Aircraft Response with Baseline Controller 



Figure 6 - Stable Aircraft Response with Standard MRAC 
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Figure 7 - Unstable Aircraft Response with Bi-Objective MRAC y w > 0 



t, sec 

Figure 8 - Stable Aircraft Response with Bi-Objective MRAC y w = 0 
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Figure 9 - Stable Aircraft Response with Bi-Objective Optimal Control Modification (OCM) 
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Figure 10 - Elevator Deflections 


IV. Conclusions 

This study presents a new method of adaptive control for systems with input uncertainty. A parallel predictor 
model is constructed to relate the predictor error to the estimation error of the control effectiveness matrix. An optimal 
control method for a bi-objective cost function to reduce both the tracking error and predictor error simultaneously 
has been developed. The bi-objective optimal control modification adaptive laws enable the adaptation using both the 
tracking error and predictor error to improve robustness of the closed-loop systems in the presence of input uncertainty. 
Simulations show that the bi-objective optimal control modification adaptive laws are quite effective in maintain good 
tracking performance while improving robustness over the standard model-reference adaptive control. 
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